Audio-Visual Perception of CV Syllable of the Standard Chinese

The paper studies the audio-visual(AV) perception of consonant-vowel(CV) syllables of the Standard Chinese. The subjects were shown the synthetic AV congruent and incongruent stimuli in a random sequence, and were asked to respond by writing what they hear through IPA symbols. Results show that the vision of consonants can affect the perception of acoustic consonants. The influence of visual signal on the consonant identity is not identical across different place of articulation. Visual signal show greatest effect on labial place perception. Labio-dental place perception is moderately affected and other places are least affected. The visual signals with labial feature affect acoustic perception more than the visual signal with other features.